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Abstract 



■ In the maximum constraint satisfaction problem (Max CSP), one is given a finite collection 

| of (possibly weighted) constraints on overlapping sets of variables, and the goal is to assign 

values from a given finite domain to the variables so as to maximize the number (or the total 
q | weight, for the weighted case) of satisfied constraints. This problem is NP-hard in general, 

and, therefore, it is natural to study how restricting the allowed types of constraints affects the 
approximability of the problem. In this paper, we show that any Max CSP problem with a 
finite set of allowed constraint types, which includes all fixed- value constraints (i.e., constraints 
' of the form x = a), is either solvable exactly in polynomial time or else is APX-complete, even 

t ■ if the number of occurrences of variables in instances is bounded. Moreover, we present a simple 

description of all polynomial-time solvable cases of our problem. This description relies on the 
. well-known algebraic combinatorial property of supermodularity. 

Keywords: maximum constraint satisfaction, complexity of approximation, dichotomy, supermod- 
el ■ ularity, Monge properties 

> 

^ 1 Introduction and Related Work 



1.1 Background 

Many combinatorial optimization problems are NP-hard, and the use of approximation algorithms 
is one of the most prolific techniques to deal with NP-hardness. However, hard optimization 
problems exhibit different behaviour with respect to approximability, and complexity theory for 
approximation is now a well-developed area 0. 

Constraint satisfaction problems (CSPs) have always played a central role in this direction of 
research, since the CSP framework contains many natural computational problems, for example, 
from propositional logic and graph theory (see, e.g., ^3 HH])- hi a CSP, informally speaking, 
one is given a finite collection of constraints on overlapping sets of variables, and the goal is to 
decide whether there is an assignment of values from a given domain to the variables satisfying all 
constraints (decision problem) or to find an assignment satisfying maximum number of constraints 
(optimization problem). These are the main versions of the CSP, and there are many other versions 
obtained from them by modifying the objective (see, e.g., RUSHES])- In this paper, we will focus 
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on the optimization problems, which are known as maximum constraint satisfaction problems, Max 
CSP for short. The most well-known examples of such problems are Max A;-Sat and Max Cut. 
Let us now formally define Max CSP. 

Let D denote a finite set with \D\ > 1. Let Rjy denote the set of all m-ary predicates over D, 

that is, functions from D m to {0, 1}, and let Rd = IJm=i ^d ' '• Also, let Z + denote the set of all 
non-negative integers. 

Definition 1.1 (constraint) A constraint over a set of variables V = {xi,X2, ■ ■ ■ ,x n } is an ex- 
pression of the form /(x) where 

• / € Rjj is called the constraint predicate; and 

• x = . . . ,Xi m ) is called the constraint scope. 

The constraint /(x) is said to be satisfied on a tuple a = (a^, . . . ,flj m ) € D m if /(a) = 1. 

Note that throughout the paper the values and 1 taken by any predicate will be considered 
as integers, not as Boolean values, and addition will always denote the addition of integers. 

Definition 1.2 (Max CSP) For a finite T C R D , an instance of Max CSP(J^) is a pair (V,C) 
where 

• V = {xi, . . . , x n } is a set of variables taking their values from the set D; 

• C is a collection of constraints /i(xi), . . . , fq(x. q ) over V , where fi £ J- for all 1 < % < q. 

The goal is to find an assignment ip : V — > D that maximizes the number of satisfied constraints, 
that is, to maximize the function f : D n — > Z + , defined by f{x\, . . . ,x n ) = Yll=ifi( x i)- If the 
constraints have (positive integral) weights Qi, 1 < % < q, then the goal is to maximize the total weight 
of satisfied constraints, that is, to maximize the function f : D n — > Z + , defined by f(x\, . . . ,x n ) = 

Ef=i 8i ■ fi( x i)- 

Complexity classifications for various versions of constraint satisfaction problems have attracted 
much attention in the recent years (see surveys (221 ESI) because, as the authors of nicely put 
it, these classifications "present as reasonably accurate bird's eye view of computational complexity 
and the equivalence classes it has created" . Classifications with respect to a set of allowed constraint 
types (such as T in Max CSP(^) above) have been of particular interest, e.g..pi71ISlini Plr71l2H . 

Boolean constraint satisfaction problems (that is, when D = {0, 1}) are by far better studied P2j 
than the non-Boolean version. The main reason is, in our opinion, that Boolean constraints can be 
conveniently described by propositional formulas which provide a flexible and easily manageable 
tool, and which have been extensively used in complexity theory from its very birth. Moreover, 
Boolean CSPs suffice to represent a number of well-known problems and to obtain results clarifying 
the structure of complexity for large classes of interesting problems ^3]- I n particular, Boolean 
CSPs were used to provide evidence for one of the most interesting phenomena in complexity theory, 
namely that interesting problems belong to a small number of complexity classes , which cannot 
be taken for granted due to Ladner's theorem. After the pioneering work of Schaefer |37j presenting 
a tractable versus NP-complete dichotomy for Boolean decision CSPs, many classification results 
have been obtained (see, e.g., ^Sj)j most of which are dichotomies. In particular, a dichotomy in 
complexity and approximability for Boolean Max CSP has been obtained by Creignou and 
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it was slightly refined in [Jj"] (see also [EI]). The complexity of Boolean Max CSP with arbitrary 
(i.e., not necessarily positive) weights was classified in |26| . 

Many papers on various versions of Boolean CSPs mention studying non-Boolean CSPs as a 
possible direction of future research, and additional motivation for it, with an extensive discus- 
sion, was given by Feder and Vardi [J7]. Dichotomy results on non-Boolean CSPs give a better 
understanding of what makes a computational problem tractable or hard, and they give a more 
clear picture of the structure of complexity of problems, since many facts observed in Boolean 
CSPs appear to be special cases of more general phenomena. Notably, many appropriate tools 
for studying non-Boolean CSPs have not been discovered until recently. For example, universal 
algebra tools have proved to be very fruitful when working with decision, counting, and quanti- 
fied CSPs IE! El IHj while ideas from lattice theory, combinatorial optimization and operations 
research have been recently suggested for optimization problems I34| . 

The problem Max CSP is NP-hard in general (i.e., without restrictions on the type of allowed 
constraints), and there is a significant body of results on algorithmic and complexity-theoretical 
aspects of this problem, including results on superpolynomial general algorithms (e.g.. |14l I39|^. 
polynomial algorithms for special cases [HJIBI], explicit approximability bounds (e.g., [T*"J [201 122J 
HSllSni)) and complexity of approximation (e.g., [3*1 [TBI 127) )• 

The main research problem that we will look at in this paper is the following. 

Problem 1 Classify the problems Max CSP (J 7 ) with respect to approximability. 

We say that a predicate is non-trivial if it is not identically 0. We will always assume that J 7 is 
finite and contains only non-trivial predicates. Whenever we do not specify which version (weighted 
or unweighted) we consider, we mean unweighted Max CSP. Note that the definition allows one to 
repeat constraints in instances (we follow [13*] in this), so our unweighted problem actually allows 
polynomially bounded weights. However, our tractability results will hold for the weighted version, 
while in our hardness results, for every we will use only instances where every constraint occurs 
at most kjr times (where kjr is a constant depending on T). 

For the Boolean case, Problem[JJwas solved in [J^[Jj3 [*""""(■ It appears that Boolean Max CSP(.F) 
problems exhibit a dichotomy in that such a problem is either solvable exactly in polynomial time or 
else APX-complete, i.e., does not admit a PTAS (polynomial-time approximation scheme) unless 
P=NP. These papers also describe the boundary between the two cases. This dichotomy result 
was extended to the case |D| = 3 in [27], which is to the best of our knowledge the only paper 
tackling Problem [JJ in the non-Boolean case. 

1.2 Results 

For a subset D' C D, let U£>> denote the predicate such that Ud'(x) = 1 if and only if x G D'. 
Let Ud = {up' / f C D}, that is, IAd is the set of all non-trivial unary predicates on D. 
Furthermore, let Co = { u {d} I d £ D}. Note that predicates from Co give rise to constraints of the 
form x = d, i.e., fixed- value constraints. 

The decision problems CSP(JF) are similar to Max CSP(^ r ), but the the task is to decide 
whether all constraints in a given instance can be simultaneously satisfied. Problems of the 
form CSP(JTuZ^d) are known as conservative (or list) CSPs, and their complexity has been com- 
pletely classified by Bulatov in [JJ, while a complexity classification for the problems of the form 
CSP(jruCz)) would imply a classification for all problems CSP(.F) [""]• 

In this paper we solve the above Problem [JJ for all sets of the form T U Cd where D is any 
finite set. (Note that this does not necessarily imply a full solution to Problem [JJ as it would 
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for decision problems.) Our result is parallel to Bulatov's classification of conservative CSPs [7j, 
but our techniques are quite different from the universal-algebraic techniques used in [7j. The 
universal-algebraic techniques from |Hj cannot be applied in the optimization setting because the 
basic properties of decision CSPs that make these techniques useful are not satisfied by Max CSP. 

It was suggested in Section 6 of that Max CSP(JTU Cd) is solvable exactly in polynomial 
time if and only if all predicates in T are supermodular with respect to some linear ordering on 
D (see definitions in Section |1J). We prove that this is indeed the case, and that in all other 
cases the problem Max CSP(.F U Cd) is APX-complete. Moreover, we show that every APX- 
complete problem of the above form is APX-complete even when we further restrict it to instances 
where the number of occurrences of variables is bounded by some (possibly large) constant. Note 
that approximability properties for constraint problems with the bounded occurrence property (as 
well as for related problems on graphs with bounded degree) have been intensively studied in the 
literature (see, e.g., Q] H [HI HHj ) • 

Our classification result uses the combinatorial property of supermodularity which is a well- 
known source of tractable optimization problems jlUl 1181 138j . and the technique of strict imple- 
mentations |13| I29j which allows one to show that an infinite family of problems can express, in a 
regular way, one of a few basic hard problems. We remark that the idea to use supermodularity 
in the analysis of the complexity of Max CSP(^ r ) is very new, and has not been even suggested 
in the literature prior to It was shown in [111 I27j that supermodularity is the only source 

of tractability for problems of the form Max CSP(.F) when D is small (i.e., \D\ < 3). This, to- 
gether with the results obtained in the present paper, suggests that supermodularity is indeed the 
appropriate tool for tackling Problem^ 

Some of our technical results (those in Appendix A) are of independent interest in combinatorics. 
In Klinz et al. study how one can permute rows and columns of a 0-1 matrix so as to avoid 
a collection of given forbidden submatrices; some results of this nature have later been used in 
constructing phylogenetic trees |35| . Klinz et al. obtain many results in this direction, but they 
leave open the case when matrices are square and rows and columns must be permuted by the 
same permutation (see Section 6 of [SB)- Our results clarify the situation in this special case for 
one type of forbidden matrices considered in Theorem 4.5 of |31j . 

The structure of the paper is as follows: Section |2] contains definitions of approximation com- 
plexity classes and reductions. In Section 03 we describe our reduction techniques, and in Section 
we give the basics of supermodularity and discuss the relevance of supermodularity in the study of 
Max CSP. Section El contains the proof of the main theorem of the paper. Finally, In Sectional we 
discuss an application of our results to the optimization version of the List ff-COLOURlNG problem 
for digraphs. Some of the technical proofs omitted from the main body of the paper can be found 
in Appendices. 

2 Basics of approximability 

A combinatorial optimization problem is defined over a set of instances (admissible input data); 
each instance I has a finite set sol(T) of feasible solutions associated with it. The objective function 
attributes a positive integer cost to every solution in sol(Z). The goal in an optimization problem 
is, given an instance 1, to find a feasible solution of optimum cost. The optimal cost is the largest 
one for maximization problems and the smallest one for minimization problems. A combinatorial 
optimization problem is said to be an NP optimization (NPO) problem if its instances and solutions 
can be recognized in polynomial time, the solutions are polynomial-bounded in the input size, and 
the objective function can be computed in polynomial time (see, e.g., (2]). 
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Definition 2.1 (performance ratio) A solution s € sol(X) to an instance I of an NPO problem 
H is r -approximate if 

max[ opt(iycost(s) l - r ' 

where Opt{I) is the optimal cost for a solution to X. An approximation algorithm for an NPO 
problem H has performance ratio lZ{n) if, given any instance 2ofH with \Z\ = n, it outputs an 
lZ{n)- approximate solution. 

Definition 2.2 (complexity classes) PO is the class of NPO problems that can be solved (to 
optimality) in polynomial time. An NPO problem II is in the class APX if there is a polynomial 
time approximation algorithm for II whose performance ratio is bounded by a constant. 

The following result is contained in Proposition 2.3 and its proof. 

Lemma 2.3 Every (weighted or not) problem Max CSP(^-") belongs to APX. Moreover, if a is 
the maximum arity of any predicate in T then there is a polynomial time algorithm which, for every 
instance T of Max CSP(J r ), produces a solution satisfying at least constraints, where q is the 
number of constraints in 1. 

Completeness in APX is defined using an appropriate reduction, called j4P-reduction. Our 
definition of this reduction follows I29| . 

Definition 2.4 (AP-reduction, APX-completeness) An NPO problem ITi is said to be AP- 
reducible to an NPO problem II2 if two polynomial-time computable functions F and G and a 
constant a exist such that 

(a) for any instance I of Hi, F(T) is an instance 0/H2; 

(b) for any instance X of Hi, and any feasible solution s' of F(Z), G(I,s') is a feasible solution 
of I; * 

(c) for any instance I of Hi, and any r > 1, if s' is an r-approximate solution of F{Z) then 
G(I,s') is an (1 + (r — l)a + o(l))- approximate solution of I where the o-notation is with 
respect to 

An NPO problem H is APX-hard if every problem in APX is AP-reducible to it. If, in 
addition, H is in APX then IT is called APX-complete. 

It is a well-known fact (see, e.g., Section 8.2.1 in [2]) that ^P-reductions compose. We shall 
now give an example of an APX-complete problem which will be used extensively in this paper. 

Example 2.5 Given a graph G = (V,E), the Maximum /c-COLOURABLE Subgraph problem, 
k > 2, is the problem of maximizing \E'\, E 1 C E, such that the graph G' = (V,E') is k-colourable. 
This problem is known to be APX- complete (it is Problem GT33 in [2}). Let neq^ denote the binary 
disequality predicate on D = {0, 1, . .. ,k — 1}, k > 2, that is, neqk(x,y) = 1 <^ x 7^ y. Consider 
the problem Max CSP({ne(/fc}) restricted to instances where every pair of variables appears in the 
scope of at most one constraint. This problem is exactly the Maximum /c-COLOURABLE Subgraph 
problem. To see this, think of vertices of a given graph as of variables that take values from D, and 
introduce the constraint neqk(x,y) for every pair of variables x,y such that (x,y) is an edge in the 
graph. It follows that the problem Max CSP({reeg%}) is APX- complete. 

Note that the weighted Max CSP ({neq^}) problem coincides with the well-known problem Max 
A;-Cut (it is Problem ND17 in ]2j)- The Max 2-Cut problem is usually referred to as simply Max 
Cut. 
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In some of our hardness proofs, it will be convenient for us to use another type of approximation- 
preserving reduction, called an L-reduction [2J. 

Definition 2.6 (L-reduction) An NPO problem Hi is said to be L-reducible to an NPO problem 
II2 if two polynomial-time computable functions F and G and positive constants a, f3 exist such that 

(a) given any instance 2 of Hi, algorithm F produces an instance 2' = F(I) 0/II2, such that the 
cost of an optimal solution for 2' , 0pt(2'), is at most a ■ 0pt(2); 

(b) given 2,2' = F(2), and any solution s' to 2' , algorithm G produces a solution s to 2 such 
that \cost{s) - OPT{2)\ < [3 ■ \cost{s') - 0PT{2')\. 

It is well known (see, e.g., Lemma 8.2 in |2J) that, within APX, the existence of an L-reduction 
from IIi to II2 implies the existence of an AP-reduction from IIi to II2. 

3 Reduction techniques 

The basic reduction technique in our APX-completeness proofs is based on strict implementations, 
see |13l I29| where this notion was introduced for the Boolean case. We will give this definition in 
a slightly different form from that of EH] , but it can easily be checked to be equivalent to the 
original one (in the case \D\ = 2). 

Definition 3.1 (strict implementation) Let Y = {y±, . . . ,y m } and Z = {z±,...,z n } be two 
disjoint sets of variables. The variables in Y are called primary and the variables in Z auxiliary. 
The set Z may be empty. Let g\ (yi), . . . , g s (ys)> s > 0, be constraints over Y U Z. If g(yi, ■ ■ ■ , y m ) 
is a predicate such that the equality 

s 

g(yi, . . .,y m ) + (a - 1) = maxVg^y,) 

i=i 

is satisfied for all yi, . . . ,y m , and some fixed a € Z + , then this equality is said to be a strict 
a-implementation of g from gi, . . . , g s . 

We use a — 1 rather than a in the above equality to ensure that this notion coincides with the 
original notion of a strict a-implementation for Boolean constraints |131 129j . The intuition behind 
the notion of strict implementation is that it allows one to modify instances while keeping control 
over costs of solutions. For example, assume that we have a constraint g(u, v) in an instance 2 
of Max CSP, and there is a strict 2-implementation 5(2/1,2/2) + 1 = max 2 (gi(yi,z) + #2(2, 2/2))- 
Then the constraint g(u,v) can be replaced by two constraints gi(u,z), g2(z,v) such that z does 
not appear in 2, and we know that every solution of cost c to 2 can be modified (by choosing an 
appropriate value for z) to a solution of cost c + 1 to the new instance. 

We say that a collection of predicates J- strictly implements a predicate g if, for some a € Z + , 
there exists a strict a-implementation of g using predicates only from T . In this case we write 

J- ==4» a /. We write J- ==> / if J- ==4» a / for some a. It is not difficult to show that if / can 
be obtained from T by a series of strict implementations then it can also be obtained by a single 
strict implementation (for the Boolean case, this is shown in Lemma 5.8 JSj)- In. this paper, we 
will use about 60 specific strict implementations for the case when \D\ =4. Each of them can be 
straightforwardly verified by hand, or by a simple computer program 1 . 

The following lemma is a simple (but important) example of how strict implementations work. 

1 An example of such a program can be obtained from the authors or be anonymously downloaded from 
http : //www . ida. liu. se/~pete j /super/modular .html. 
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Lemma 3.2 Cd strictly implements every predicate inUo- 



Proof: It is easy to see that, for any D' C D, uo'{x) = J^deD' u d( x ) is a strict 1-implementation. 



In our proofs, we will use problems with the bounded occurrence property, so we now introduce 
notation for such problems. 

Definition 3.3 (bounded occurrence problems) Max CSP(.F) — k will denote the problem 
Max CSP(.F) restricted to instances with the number of occurrences of variables is bounded by 
k. We will write that Max CSP(T) - B is APX-complete to denote that Max CSP(.F) — k is 
APX- complete for some k. 

Note that, by definition, repetitions of constraints in instances of Max CSP are allowed. If 
a variable occurs t times in a constraint which appears s times in an instance, then this would 
contribute t ■ s to the number of occurrences of that variable in the instance. 

Lemma 3.4 If J- strictly implements a predicate f , and Max CSP(.F U {/})— B is APX- complete, 
then Max CSP(J r ) - B is APX- complete as well. 

Proof: This lemma for the Boolean case, but without the assumption on bounded occurrences, 
is Lemma 5.18 in |13j . Our proof is almost identical to the proof of Lemma 5.18 in [13] . and it uses 
the same AP-reduction. Essentially, we only need to verify that the mapping F in this reduction 
preserves the bounded occurrence property. 

Let k be a number such that Max CSP(.FU {/}) — A: is APX-complete and let a € Z + be 

such that J- ==^ a f ■ Take an arbitrary instance X of Max CSP(JFU {/}) — k. Note that every 
predicate in T can be (trivially) strictly a-implemented from T in such a way that each auxiliary 
variable appears only once in the strict implementation (simply use any satisfiable collection of a — 1 
constraints with no repetitions of variables); this is a small technicality which ensures uniformity 
in the following transformation of instances. Replace every constraint in X by a set of constraints 
appearing in the right-hand side of its strict ce-implementation from T, keeping the same primary 
variables and using fresh copies of auxiliary variables every time. Denote the obtained instance 
by X'. The function F in this AP-reduction will be such that F(X) = I' for all X. Let t be the 
maximum number of occurrences of a variable (primary or auxiliary) in the right-hand side of the 
strict implementation of / from T . It is clear that X' is an instance of Max CSP(JF), and that the 
number of occurrences of any variable in X 1 is bounded by k' = tk. 

Let V be the set of variables in X' . Let ip' : V — ► D be an r-approximate solution to X '. The 
mapping G uses two possible solutions to X and takes the better of the two. The first solution is 
(p' | y, while the second is a solution satisfying (3 = constraints which exists by Lemma 12.31 fhere 
a is the maximum arity of constraints in J 7 U {/}). 

One can show, by literally repeating the argument in the proof of Lemma 5.18 in that 
G(ip') is an r'- approximate solution to X where r' < 1 + 7(r — 1) with 7 = (3{ct — 1) + 1. 



We have constructed an AP-reduction from Max CSP(J^U {/}) - k to Max CSP(J^) - k' , 



Lemma 13.41 will be used as follows in our APX-completeness proofs: if J-' is a fixed finite 
collection of predicates each of which can be strictly implemented by T then we can assume that 
T' C T . For example, if T contains a binary predicate / then we can assume, at any time when it is 



□ 



thus proving the lemma. 



□ 
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convenient, that J- also contains f'(x,y) = f(y,x), since this equality is a strict 1-implementation 
of /'. 

Finally, we will use a technique based on domain restriction. For a subset D' C D, let T\d* = 
{/|d' | / € «F and /j^j/ is non-trivial}. 

Lemma 3.5 Lei D' Q D and u D > G J". // Max CSP^^/) - B is APX- complete then so is 
Max CSP(.F) - B. 

Proof: Let k be a bound on the number of occurences such that Max CSP^I^') — A; is APX- 
complete. We establish an L-reduction from Max CSP(T\d') — k to Max CSP(:F) — k! where 
k' = 2k. 

An instance I of Max CSP^Id') — k corresponding to f(x\, . . . ,x n ) = Yli=i /i( x «) wm De 
mapped to an instance X' corresponding to f'(xi, . . . ,x n ) = Ylt=i /i( x «) + & Ya=i u D'{xi) where 
each f- £ T is such that f[\D' = fi- We may without loss of generality assume that all n variables xi 
actually appear in constraint scopes in I. Note that I' is indeed an instance of Max CSP(^") — k'. 

Let V = {x±, . . . , x n } and fix an element d G D' . If <p' : V — >■ D is a solution to I', then it is 
modified to a solution to X as follows: set (p(xi) = d whenever (p'(xi) D', and <p{xi) = (f'(xi) 
otherwise. 

We will show that this pair of mappings is an L-reduction for suitable a and (5. 

Note that, for any solution to X', changing all values outside of D' to any values in D' can only 
increase the cost of the solution. This follows from the fact that, by changing any value outside of 
D' to a value in D' , we can lose at most k satisfied constraints, but we satisfy k constraints of the 
form uo'{x). It follows that Opt{X') = Opt(Z) + kn. 

Let a be the maximum arity of constraints in J-\d'- Let c = jjjjz- Then we have c ■ q < Opt(Z) 
by Lemma IP Set a = — + 1. Note that we have n < aq because the total length of constraint 
scopes in I is at least n and at most aq. Since n < aq < a ° pt ^ L > ; we have 

Opt(l') = Opt(X) + kn< Opt(l) + k a0pt ^ = a . Opt(I), 

so the first property of an L-reduction is satisfied. 

We will now show that the second property is satisfied with (3 = 1. Let (p 1 and ip be solutions 
to X' and X, respectively, such as described above. 

Let V\ be the set of variables which ip 1 sends to D \ D', and V2 the variables sent to D'\ 
set r = |V^|. Divide all constraints in X' into three pairwise disjoint groups: C\ consists of all 
constraints /j(xj) that contain at least one variable from Vi, C2 of all constraints /i(xj) that use 
variables only from V2, and C3 contains the kn constraints of the form U£>>(xi). Let q\ = \C\\ and 
Q2 = I C2 1 . Furthermore, let s± and S2 be the numbers of constraints in C\ and C2, respectively, that 
are satisfied by (p. By the bounded occurrence property, we have s± < q\ < (n — r)k. In particular, 
it follows that s\ — nk + rk < 0. Note also that cost(<p') = s\ + S2 + rk and S2 < cost{(p). Finally, 
we have 

Opt (I) - cost(cp) < Opt(X) -s 2 = 
[Opt(X) + nk] - [si + s 2 + rk] + [si - nk + rk] < Opt(X') - cost(ip'). 

□ 

To make use of results in |1 II I27| . we need to introduce some more notation. 
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Definition 3.6 (endomorphism, core) An endomorphism of J 7 is a unary operation fi on D 
such that, for all f E T and all (ai, . . . , a m ) 6 D m , we have 

f(ai, . . . , a m ) = 1 =>- /(/u(ai), . . . , fJ,(a m )) = 1. 

We will say that T is a core if every endomorphism of T is injective (i.e., a permutation). 
If /i is an endomorphism of J- with a minimal image im(p) = D' then a core of T , denoted 
core('F), is the set T\y)i . 

The intuition here is that if T is not a core then it has a non-injective endomorphism /x, which 
implies that, for every assignment ip, there is another assignment \np that satisfies all constraints 
satisfied by ip and uses only a restricted set of values, so the problem is equivalent to a problem 
over this smaller set. As in the case of graphs, all cores of J- are isomorphic, so one can speak 
about the core of T. The following rather simple corollary from Lemma 13.51 will be useful in our 
proofs. 

Corollary 3.7 Assume that T' = core[T) and Max CSPfT') — B is APX-complete. Then 
Max CSP(T) - B is APX-complete as well. 

Example 3.8 Every set T containing Co is a core because the only endomorphism of Cd is the 
identity operation. 

4 Supermodularity and Monge properties 
4.1 Basics of supermodularity 

In this section we discuss the well-known combinatorial algebraic property of supermodularity [3H| 
which will play a crucial role in classifying the approximability of Max CSP problems. 

A partial order on a set D is called a lattice order if, for every x, y € D, there exists a greatest 
lower bound xFly and a least upper bound xLiy. The corresponding algebra C = (D, n, U) is called 
a lattice. For tuples a = (oi, . . . , a n ), b = (&i, . . . , b n ) in D n , let a n b and a U b denote the tuples 
(ai n b±, . . . , a n n b n ) and (ai U b±, . . . , a n U b n ), respectively. 

Definition 4.1 (supermodular function) Let £ be a lattice on D. A function f : D n — > Z + is 
called supermodular on C if 

/(a) + /(b) < /(a n b) + /(a U b) for all a, b € D n . 

Note that predicates are functions, so it makes sense to consider supermodular predicates. We 
say that J 7 Q Rd is supermodular on C if every / G J- has this property. 

A finite lattice C = (D, n, U) is distributive if and only if it can be represented by subsets 
of a set A, where the operations n and U are interpreted as set-theoretic intersection and union, 
respectively. Totally ordered lattices, or chains, will be of special interest in this paper. Note that, 
for chains, the operations n and U are simply min and max. Hence, the supermodularity property 
for an n-ary function / on a chain is expressed as follows: 

fifli, . . . ,a n ) + ... ,&n) < 

/(min(ai,&i), . . . , min(a n , b n )) + /(max(ai, b x ), . . . , max(ai, b x )) 
for all oi, . . . ,a n ,bi, . . . ,b n . 
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Example 4.2 

1) The disequality predicate neqo is not supermodular on any chain on D. Take two elements 
d\ , c?2 E D such that d\ < d^ ■ Then 

neqn(di,d 2 ) + neqo(d2, d\) = 2^0 = neqo{di,di) + neqnfa, d 2 ). 

2) Fix a chain on D and let a, b be arbitrary elements of D 2 . Consider the binary predicate f a , 
f h and /k defined by the rules 

U(x,y) = 1 ^ (x,y) < a, 
f h ( Xi y) = l ^ (x,y)>b, 

ft( x ,v) = l (x,y) < a or (x,y) > b, 

where the order on D 2 is component-wise. It is easy to check that every predicate defined above 
in this part of the example is supermodular on the chain. Note that such predicates were consid- 
ered in lllf where they were called generalized 2-monotone. We will see later in this subsection 
(Lemma \4-4\ ) that such predicates are generic supermodular binary predicates on a chain. 

We will now make some simple, but useful, observations. 

Observation 4.3 



1. Any chain is a distributive lattice. 

2. Any unary predicate on D is supermodular on any chain on D. 

3. A predicate is supermodular on a chain if and only if it is supermodular on its dual chain 
(obtained by reversing the order). 

Given a chain in D, any binary function / on D can be represented as a \D\ x \D\ matrix M 
such that M{x,y) = f(x,y); here the chain indicates the order of indices of M, and M(x,y) is 
the entry in row x and column y of M. Note that this matrix is essentially the table of values of 
the predicate. For example, some binary predicates on D = {0, 1,2,3} that are supermodular on 
the chain < 1 < 2 < 3 are listed in Fig. ^ (these predicates will be used later in the proof of 
Theorem 15 .4JI . Note that all predicates in Fig. ^ have the form described in Example 14.2( 2). For 
example, h% is //gf? an d hyj is ft^'iy 



1000 1100 1110 1100 1110 1110 1100 1110 1000 1100 1110 1110 1000 

h 0000 h 0000 h 0000 h 1100 h 1110 h 1110 h 0000 h 0000 h 1000 h 1100 h 1110 h 0001 h 1001 

ftl 0000 " 2 0000 ft3 0000 114 0000 ft5 0000 ftf3 1110 ft7 0001 " 8 0001 " 9 0001 ft i0 0001 ftll 0001 ftl2 0001 "-"oooi 

0001 0001 0001 0001 0001 0001 0001 0001 0001 0001 0001 0001 0001 



1100 1000 1100 1100 1100 

h 1101 h 1001 h 1100 t^HOl h o 1100 

ftl4 0001 ftl5 1001 ftl6 1101 " 17 1101 ftl8 0011 

0001 0001 0001 0001 0011 



Figure 1: A list of predicates on {0, 1,2,3} which are supermodular on the chain < 1 < 2 < 3. 
The predicates are represented by tables of values. 

A square matrix M is called anti-Monge (or a-Monge, for short) 2 if M(i,s) + M(r,j) < 
+ M(r,s) for all i < r and j < s. It is well known (and easy to check) that matrices 

2 Other names used for such matrices are inverse Monge and dual Monge. 
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corresponding to binary supermodular functions on a chain are precisely the a-Monge matrices 
(see, e.g., Observation 6.1 in ^UJ ) . Hence, one can view the tables in Fig. ^ as a-Monge matrices. 
We will be particularly interested in binary supermodular predicates on chains, and the next result 
describes the structure of 0-1 a-Monge square matrices. 

In order to make the correspondence between matrices and binary functions more transparent, 
we will use the set J = {0, . . . , n — 1} to number rows and columns of an n x n matrix. Let Vff 
denote the square 0-1 matrix of size n such that L^(i,j) = 1 if and only if i < p and j < q. 
Similarly, denotes the square 0-1 matrix of size n such that R^(i,j) = 1 if and only if i > s 
and j > t. Let U and W be two subsets of J. We denote by M[U, W] the \U\ x \W\ submatrix of 
M that is obtained by deleting all rows not contained in U and all columns not in W. Expression 
M[U, W] = a will mean that all elements in the submatrix are equal to a. 

Lemma 4.4 A non-zero 0-1 matrix M of size n x n without all-ones rows and columns is an 
a-Monge matrix if and only if one of the following holds 

• M = Ln 9 , for some < p, q < n — 2, or 

• M = R st , for some 1 < s, t < n — 1, or 

• M = + R^f for some < p, q < n — 2 and 1 < s, t < n — 1, with p < s, or q < t, or both. 

Proof: It is easy to see that matrices L^ 9 , R^ and + R^ are a-Monge matrices. Assume now 
that matrix M is an a-Monge matrix. We consider two cases: M(0,0) = and M(0,0) = 1. 

In what follows we use the following 0-1 property of 0-1 a-Monge matrices: 

• if M(i, k) = 0,M(i,j) = 1 for k < j, then M(l,k) = 0,M(l,j) = 1 for all I > i; 

• if M(i,k) = 0,M(l,k) = 1 for i < I, then M(i,j) = 0,M(l,j) = 1 for all j > k; 

• if M(l, k) = l,M(l,j) = for k < j, then M(i,k) = l,M(i,j) = for all i < I; 

• HM(i,j) = l,M(l,j) = for i < I, then M(i,k) = l,M(l,k) = for all k < j. 

Let M(0, 0) = 0. It follows from the 0-1 property that then row and column in the matrix 
contain only zeros because, otherwise, the matrix would have an all-ones row or column. 

Let M(u, v ) = 1 for some u, v > 0. Since the row and column contain only zeros, the 0-1 
property yields M(x, y) = 1 for all x > u, y > v (and, in particular, M(n — l,n — 1) = 1). Let s 
be the smallest row containing one (s > 0), and t be the smallest column containing one in row 
s. We claim that there is no column j, j < t, with M(z,j) = 1 for some z. Indeed, in this case 
the submatrix M[{s, z}, {j, t}] would not be an a-Monge matrix. This completes the proof that, 
in the case when M(0,0) = 0, we have M = R^, for some 1 < s,t < n — 1. If M(0, 0) = 1 and 
M{n — 1, n — 1) = 0, then by symmetry, we have M = L^ 1 , for some < p, q < n — 2. 

Let us now consider the case with M(0, 0) = M(n — 1, n — 1) = 1. Recall that, by assumption, 
every row and every column of M contains at least one 0. Let p + 1 be the smallest row with in 
column 0, and g-fl be the smallest column with in row 0. Then we have M[{0, . . . ,p}, {0, . . . , q}] = 
1. Indeed, if there is M(i,j) = for some < i < p and < j < q then we choose this element 
to be as close to the left-top corner as possible, and the submatrix M[{i — {j — l,j}] is not 
a-Monge. Furthermore, let s — 1 be the largest row with in the last column, and t — 1 be the 
largest column with in the last row. As above, we have M[{s, . . . , n — 1}, {t, . . . , n — 1}] = 1. 
Note that we have p < s, or q < t, or both, since, otherwise, M would contain an all-ones row or 
column. 
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It follows from the 0-1 property that M(j, 0) = for all j > p and M{n — 1,1) =0 for all 
I < t. As above, we derive that M[{p + l,...,n — 1}, {0, . . . , t}] = 0. By similar arguments, 
M[{0, . . . , s}, {q + 1, . . . , n — 1}] = 0. This completes the proof of the lemma in the case when 
both p < s and q < t. By symmetry, it is now enough to consider the case when p < s and q > t. 
It remains to show that M [{p + 1, . . . , s}, {t + 1, . . . , q}] =0. Assume that M(i,j) = 1 for some 
p+ 1 < i < s and t+ 1 < q. Column j contains a zero, that is, M(k,j) = for some p+ 1 < k < s. 
It is easy to check that if i < k then M[{0, j}, {i, k}] is not a-Monge. Similarly, if k < i then 
M[{j, n — 1}, is not a-Monge. The lemma is proved. □ 

The family of ra-ary supermodular functions on a chain was also studied under the name of n- 
dimensional anti-Monge arrays |lf)| . As a special case of Lemma 6.3 of |lf)j . we have the following 
result (see also Observation 6.1 of [TU]b 

Lemma 4.5 An n-ary, n > 2, function f is supermodular on a fixed chain if and only if the 
following holds: every binary function obtained from f by replacing any given n — 2 variables by 
any constants is supermodular on this chain. 

4.2 Super-modularity and Max CSP 

The property of supermodularity has been used to classify the approximability of problems Max CSP(JF) 
for small sets D (though, originally the classification for the case \D\ = 2 was obtained and stated 
in ^21 El EH] without using this property). 

Theorem 4.6 Il3\ \27\ ) Let \D\ < 3 and let T C Rpj be a core. If T is supermodular on 
some chain on D then weighted Max CSP(J-") belongs to PO. Otherwise, Max CSP(^-") is APX- 
complete. 

Remark 4.7 It was shown in Lemma 5.37 of \l 6 J\j that, for D = {0, 1}, JF C i?{o,i} can strictly 
implement neq2 whenever Max CSP(JF) is APX- complete in the above theorem (i.e. whenever J 7 
is a core that is not supermodular on any chain). Moreover, it follows from (the proof of) Theorem 
3 \27]l that if \D\ = 3 and T is supermodular on some chain on D then J-\JCq can strictly express 
neq2 or neq^ by using a sequence of the following operations: 

• adding to J 7 a predicate that can be strictly implemented from J- 

• taking the core of a subset of T (i.e., replacing T by a subset of J-\d' for some D' C D). 

It was shown in jl] that Max Cut remains APX-complete even when restricted to cubic 
graphs. Since Max Cut is the same problem as Max CSP({ne(/2}) (see Example 12.5(1 . it follows 
that Max CSP({neg2}) — B is APX-complete. Moreover, since neqk\{o t iy = neq2, it follows from 
Lemma 13.51 that Max CSP({neqfc, U{o,i}}) — B is APX-complete for any k. Therefore, we obtain 
the following corollary by combining Eemark 14.71 with Lemmas 13.41 and 13.51 

Corollary 4.8 Let \D\ < 3 and T not supermodular on any chain on D. Then the problem 
Max CSPOFUWd) - B is APX-complete. 

The tractability part of our classification is contained in the following result: 

Theorem 4.9 If T is supermodular on some distributive lattice on D, then weighted 

Max CSP(^) is in PO. 
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5 Main result 



We will need the following two technical lemmas. They will be used in our hardness proof to 
reduce the argument to the case when all non-unary predicates are binary and their matrices do 
not contain all-ones rows or columns. 

Lemma 5.1 If T is not super-modular on any chain on D then J-L)Ud can strictly implement a 
collection T' of binary predicates which is is not supermodular on any chain on D. 

Proof: Let / € 3~ be not supermodular on some fixed chain. By Observation ^. 3f 2). / is n-ary with 
n > 2. By Lemma 14.51 it is possible to substitute constants for some n — 2 variables of / to obtain 
a binary predicate /' which is not supermodular on this chain. Assume without loss of generality 
that these variables are the last n — 2 variables, and the corresponding constants are d 3 , . . . , d n , 
that is, f'(x, y) = f(x, y, d 3 , . . . , d n ). Then the following is a strict (n — l)-implementation of /': 

f{x,y) + (n - 2) = max [f(x,y,z 3 ,.. .,z n ) + u {d3 y(z 3 ) + . . . + u {dn} (z n )}. 

Repeating this for all chains on D, one can strictly implement a collection T' of binary predicates 
that is not supermodular on any chain. □ 



Lemma 5.2 [Lemma 3.3 \2% ] Assume that h € R D and there is a € D such that h(x,a) = 1 for 
all x £ D. Let h'(x,y) = if y = a and h'(x,y) = h(x,y) if y ^ a. Then the following holds: 

1. for any chain on D, h and h! are supermodular (or not supermodular) on the chain simulta- 
neously; 

2. the problems Max CSP({/i} U U D ) and Max CSP({/i'} U U D ) are AP-reducible to each other. 

The next result immediately follows from Corollary IA..3I and Proposition lA.61 (see Appendix A), 
by using the correspondence between 0-1 a-Monge matrices and binary supermodular predicates. 

Proposition 5.3 If J- is a set of binary predicates that is not supermodular on any chain on D 
then there exist J 7 ' C T with < 3 and D' C D with \D'\ < 4 such that T'\n' is not supermodular 
on any chain on D' . 

Recall that all predicates from Co are supermodular on any chain on D. We will now prove our 
main result: 

Theorem 5.4 If J- is supermodular on some chain on D then weighted Max CSP(JF U Cd) belongs 
to PO. Otherwise, Max CSP(J'UCd) - B is APX- complete. 

Proof: The tractability part of the proof follows immediately from Theorem 14.91 fsee also Obser- 
vation EHJl))- By Lemmas 13.21 and 13.41 it is sufficient to prove the hardness part for sets of the 
form T VMAd- We will show that {ne^} can be obtained from T VMAd by using the following two 
operations: 

1. replacing T U Ud by a subset of T U lAr> U {/} where / is a predicate that can be strictly 
implemented from T U Ud ', 

2. replacing T U Ud by a subset of T\d> U Ud< for some D'. 
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By Example 12.51 and Lemmas 13.41 and 13.51 this will establish the result. 

It follows from Lemmas 15.11 and 13 . 41 that it is sufficient to prove the hardness part of Theorem 15. 41 
assuming that T contains only binary predicates. Now, Proposition 15.31 and Lemma f3. 51 imply that, 
in addition, we can assume that \T\ < 3 and \D\ < 4. Note that the case \D\ < 3 is already 
considered in Corollary 14.81 fsee also Remark 14. 7|) . so it remains to consider the case \D\ =4; we 
can without loss of generality assume in the rest of the proof that D = {0, 1, 2, 3}. Moreover, due 
to Lemma 13.51 we may consider only sets T satisfying the following condition: 

for any proper subset D' C D, J-\d> is supermodular on some chain on D' . (*) 

We can assume that T is minimal with respect to inclusion, that is, every proper non-empty 
subset of J- is supermodular on some chain on D. We will consider three cases depending on the 
number of predicates in T. Note that, by Lemma 15.21 we can without loss of generality assume 
that none of the predicates in T has a matrix containing an all-ones row or column (this property 
does not depend on the order of indices in the matrix). 

We prove the result by using a computer-generated case analysis in each of the three cases. In 
each case, we first produce a list of all possible sets T with the above restrictions, then optimize 
the list by using various symmetries, and, finally, for each remaining set provide a strict imple- 
mentation of a set T' that is known to have an APX-hard Max CSP(-F') problem. To compactly 
describe such symmetries, we introduce some notation. Let tt be a permutation on D and / a 
binary predicate on D. Then, we define vr(/) to be the predicate such that ir(f)(a,b) = 1 if and 
only if /(-7r(a), n(b)) = 1 for all a, b € D; in this case we say that the predicate 7r(/) is isomorphic 
to /. We also define the predicate / so that / (a, b) = 1 if and only if f(b, a) = 1 for all a,b € D 
(this corresponds to transposing the matrix of /). We say that a predicate of the form 7r(/*) is 
anti- isomorphic to /. 

Case 1. \T\ = 1. 

First, we use exhaustive search to generate the list of all binary predicates / on D that (a) do 
not have all-ones rows or columns, (b) are not supermodular on any chain on D, and (c) T = {/} 
satisfies condition (*). Moreover, we may consider predicates only up to isomorphism and anti- 
isomorphism. Thus, this list is then processed as follows: for every predicate / in the list, in order, 
remove all predicates below / in the list that are isomorphic or anti-isomorphic to /. 

Clearly, it is sufficient to prove the hardness result for all predicates that remain in the optimized 
list. Since there are only 2 16 = 65536 predicates to check, it is clear that generating and optimizing 
the list can easily be (and actually was) performed by a computer. The optimized list contains 
only 27 predicates which are given in Fig. El 

We show, starting from and proceeding in order, that {/i-} U Uq strictly implements some 
binary predicate g such that either, for some D 1 C D, the predicate g\r>' is not supermodular on 
any chain on D' or g is equal to h'- for some j < i (up to isomorphism and anti- isomorphism). 
These implementations can be found in Appendix B. This, together with Remark 14 .71 implies that 
neq2 can be obtained from T UUd- 

Case 2. \T\ = 2. 

Let T = /2}. As in Case 1, we use exhaustive search to generate the list of all pairs of binary 
predicates on D such that (a) they do not have all-ones rows or columns, (b) each of the two 
predicates is supermodular on at least one chain, but there is no chain on which they are both 
supermodular, and (c) T satisfies condition (*). Without loss of generality, we can assume that f\ 
is supermodular on the chain < 1 < 2 < 3, that is, the matrix of f\ with this order of indices is 
a-Monge. Since the matrix of f\ does not have all-ones row or column, its structure is described in 
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1000 1000 1001 1010 1010 1010 1010 1011 1011 1011 1011 1011 1011 

y 0110 h , 1101 h i 0111 y 0101 h , 0110 h i 0111 h i 0111 h i 0101 h , 0111 h > 0111 h / 0111 h i 0111 i. / 0111 

"i 1000 "2 1000 ™3 1110 ft 4 1010 ft 5 0000 "e 1010 "7 1110 "s 1010 ft 9 0010 "-10 0010 "nOOll "12 0110 ft i3l010 

0000 0000 1001 1000 0000 1000 1000 0000 0000 0001 0000 1001 0000 

1011 1011 1011 1011 1011 1011 1100 1101 1101 1101 1101 1110 1110 

h , 0111 h , 0111 h , 0111 h , 0111 h , 0111 h i 1101 h , 1101 h , 0110 1100 h , 1110 1110 1100 h i 1100 

"■14 1010 "l5lllO "lOlllO ft 17lll0 "lSlllO "l9l010 "20 1000 "210110 "22 0010 "23 0000 "24 0110 "25 0000 "26 1010 

0001 0000 0001 1001 1101 0000 0000 1001 0000 0000 1001 0000 0000 

1110 
h i 1101 

"27 1010 

0000 



Figure 2: The optimized list of 27 predicates from the proof of Case 1. The predicates are repre- 
sented by tables of values. 

Lemma 14.41 Similarly, the matrix of f2 is a permuted a-Monge matrix, since 7r(/2) is supermodular 
for some permutation ir. 

We can also assume that the a-Monge matrices for f\ and /2 (with respect to the orders on 
which the predicates are supermodular) have the third form {L pq + -R|*) from Lemma 14.41 The 
reason is that if, say, the matrix of /i has the form L pq for some < p, q < 2 then f[(x,y) + 1 = 
fi(x, y) + W{ p +i,... i 3}(x) +W{ g+lj _ j 3}(y) is a strict 2-implementation of the predicate /' whose matrix 

is i?4 >+1 ^ 9+1 \ Moreover, f'{(x,y) = fi(x,y) + f[(x,y) is a strict 1-implementation of a predicate 
whose matrix is L pq + R^f +1 ^ q+1 \ Hence, we can replace f\ by /{' in this pair, and show the 
hardness result for {/{',/2}- 

It is clear that if prove the result for all pairs (/i, ^2) with some fixed /1, then this also proves 
the result for all pairs with the first component /*, or vr(/i), or 7r(/*) where 7r(x) = 3 — x. This 
implies that it is sufficient to consider only predicates from Fig. ^ as possible candidates for f\. 
Moreover, it can be straightforwardly checked by using a computer that if f\ is one of the predicates 
hi,hs,hi,he,h7,hg,hio from Fig. ^ then T = {/i,/2} fails to satisfy condition (*). Hence, all 
pairs /2), where at least one of f\ and ir(f2) (for some permutation it) coincides with one of 7 
predicates above, will not be on the list of pairs that we need to consider. 

Obviously, if we prove the result for some pair (f\, /2) 1 then this also proves the result for (/1, flf). 
Hence, provided /2 7^ f^, one of these two pairs can be excluded from the list. 

Now we show that predicates /15, /in, /J12, and hyj from Fig. ^can also be excluded from con- 
sideration because they can strictly implement some other predicates from Fig.^ Implementations: 

{1100 ^ 1100 
/ : = 1101 \ u u d ^6 0001 = : .9 / = ^17, g = 7r(/i 8 ) where tt(x) =3-x 
0001 J 0001 

g(x,y) + 5 = max ZyW [f(z,w) + f(z,y) + f(x, z) + f(x,w) + u {0 ^ } (z) + u {3} (w) + u {0} (x)} 

{1110 ~j 1110 
/ : = 0001 \ u U D ==^3 0000 ='-9 f = hu,g = h 5 
0001 J 0001 

g(x, y) + 2 = max z [f(z, x) + f(z, y) + f(x, z)] 

{1110 1100 
/ : = 0000 ( u Ud =^2 iio? =: g f = fi5,g = hw 
0001 J 0001 

g(x, y) + 1 = max z [f(x, z) + f(y, z) + w {2} (x)] 
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{1110 1000 

f _ 0001 I i i i / s , 1001 r l u 

J ■— oooi u "fl=^4 iooi - : 9 J = ">l2,g = "15 

0001 J 0001 

g(ar, y) + 3 = max z [f{z, x) + f(z, y) + f(x, z) + f(y, z) + u {1} (z) + u {ia} {x)} 

As above, all pairs (/i, /2) 1 such that, for some permutation n, 7r(/2) or ^(/l) is one of h$, /in, /112, /117, 
can also be excluded from the list. 

Finally, we can exclude from the list all pairs isomorphic to some pair higher up in the list. 
That is, we exclude pair (fx, $2) if there is a permutation ir such that either vr(/i) = f\ and the pair 
(/1, 7r(/2)) is above /2) in the list or if there is a permutation tt such that the pair (7r(/2), vr(/i)) 
is above ^2) in the list (in the latter case, 7r(/2) must be supermodular on < 1 < 2 < 3). 

The optimized list now contains 27 pairs of predicates. In Appendix C, we provide strict 
implementations for them that show that, for each pair /2) in this list, ^jU^D implements 
either a pair above it in the list or else a binary predicate g such that, for some D' C D, the predicate 
g\D> is not supermodular on any chain on D' . As in Case 1, it follows that neq2 can be obtained 
from T U Ud- 

Case 3. \T\ = 3. 

It can be checked by computer-assisted exhaustive search that there does not exist such a set J-. 5 
Simply loop through all triples of (not necessarily distinct) binary predicates on {0, 1, 2} which are 
supermodular on the chain < 1 < 2 and check that each possible extension to a triple of pairwise 
distinct predicates on D results in a set T satisfying one of the following conditions: 

1. J 7 is supermodular on some chain on D, 

2. for some D' C D, J-\d' is not supermodular on any chain on D', 

3. some proper subset of T is not supermodular on any chain on D. 

□ 

Remark 5.5 Note that, for any fixed D, it can be checked in polynomial time whether a given T 
is supermodular on some chain on D. That is, given T , we can check in polynomial time whether 
Max CSP^UCd) is tractable or APX- complete. 

6 Application to List i7-COLOPJNG optimization 

Recall that a homomorphism from a digraph G = (Vq, Aq) to a digraph H = (Vh, Ah) is a mapping 
<P '• Vg ~* Vh such that ((f(v), (f(w)) € Ah whenever (v,w) € Aq- In this case, the digraph G is 
said to be H-colorable. The Graph if-COLORABiLiTY problem is, given a digraph G, to decide 
whether it is .ff -color able. This problem attracts much attention in graph theory |25j . 

In this section, we consider the case when T consists of a single binary predicate h. This 
predicate specifies a digraph H such that Vh = D and (u, v) is an arc in H if and only if h(u, v ) = 1. 
Any instance I = (V, C) of CSP({/i}) can be associated with a digraph G% whose nodes are 
the variables in V and whose arcs are the scopes of constraints in C. It is not difficult to see 
that the question whether all constraints in X are simultaneously satisfiable is equivalent to the 
question whether Gj is -ff-colorable. Therefore, the problem CSP({/i}) is precisely the Graph 
.£/-COLORABiLrTY problem for the digraph H. The problems CSP({/i} UUd) and CSP({/i} U Co) 

3 The authors also have a (rather lengthy) combinatorial proof of this fact. 
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are equivalent to the List //-coloring and //-retraction problems, respectively. In the former 
problem, every vertex of an input digraph G gets a list of allowed target vertices in H, and the 
question is whether G has an //-coloring subject to the list constraints. The latter problem is the 
same except that each list contains either one or all vertices of H. These problems also attract 
much attention in graph theory |25j . 

The problem Max CSP({/i} UUd) can then be viewed as the List //-coloring optimization 
problem: for every vertex v of an input digraph G, there is a list L v C Vjj along with a function 
p v : L v — > Z + that indicates the 'score' which a mapping Vq — > Vh gets if it sends v to a certain 
vertex (if a mapping sends v to a vertex outside of L v then this adds nothing to the 'cost' of this 
mapping). Then the goal is to maximize the combined 'cost' of such a mapping which is obtained 
by adding weights of preserved arcs and 'scores' from the lists. The 'score' functions p v arise as the 
result of the possible presence in C of several weighted constraints of the form ujji(v) for different 
D' C D and the same v. Thus, Theorem 15.41 in the case when T = {h} presents a complexity 
classification of list //-coloring optimization problems. Digraphs H corresponding to the tractable 
cases of this problem are the digraphs that have an a-Monge adjacency matrix under some total 
ordering on Vh (note that this property of digraphs can be recognised in polynomial time, e.g., by 
using Proposition I5.3j) . Such matrices without all-one rows or columns are described in Lemma [4.41 
It remains to note that, as is easy to see, replacing either some all-zero row or some all-zero columns 
with all-one ones does not affect the property of being a-Monge. 

We remark that another problem related to optimizing list homomorphisms between graphs 
was recently considered in in connection with some problems arising in defence logistics. 
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A Appendix A: Permuted a-Monge matrices 



In this appendix, we prove results about a-Monge matrices that will imply, via the correspondence 
between binary supermodular predicates on chains and a-Monge matrices, Proposition 15.31 

If T is a set of binary predicates that is not supermodular on any chain on D, then there exists 
J-' C JF with < 3 and D' C D with \D'\ < 4 such that T'\d> is not supermodular on any chain 
on D' . 

We prove this in two steps: the existence of D' is established in Section IA.1I and the existence 
of J-' in Section IA.2I Our results about matrices will be more general than required to prove 
Proposition 15.31 because will consider general (i.e., not necessarily 0-1) matrices. 

First, we need to introduce some concepts and notation. Let M be an n x n matrix. If there is a 
permutation tt that simultaneously permutes rows and columns of M so that the resulting matrix is 
an a-Monge matrix, then the matrix M is called a permuted a-Monge matrix and the permutation 
is called an a-Monge permutation for M. Note that we will often use the term 'permutation' as 
a synonym for 'linear (re-)ordering'. Given a set of indices I = . . . , i^} C J = {0, . . . , n — 1}, 
we use notation M[I] for the sub-matrix M[I,I]. We say that M[I] is permuted according to a 
permutation (s±, . . . , Sk), where / = {si, . . . , s^}, if row (column) s\ is the first row (column) in 
the permuted matrix, S2 is the second row (column), and so on. If n < 4 and M is not a permuted 
a-Monge matrix, then M is called a bad matrix. 

A row i precedes a row j in M (i -< j for short), if row i occurs before row j in M. If i precedes j 
in a permutation tt, then we write i -< n j. When the permutation tt is understood from the context, 
we simply write i -< j. If tt is an a-Monge permutation for the matrix M, then the reverse of tt, 
tt~ defined as tt~{i) = ir(n — 1 — i), is also an a-Monge permutation. Therefore, given two indices 
i and j, we can always assume that i precedes j in an a-Monge permutation (if there is any). 

Denote by A(i, j, k, I), for i,j, k,l G J, an algebraic sum that involves four entries of the matrix 
M: A(i, j, k, I) = M(i, k) + M(j, I) — M (i, I) — M(j, k). Given a permutation tt for permuting rows 
and columns in M, we use a similar notation for the sums in the permuted matrix: A(i, j, k, I, tt) = 
M(ir(i),ir(k)) + M(vr(j), vr(/)) - M(n{i),n{l)) - M{iv{j),ir(k)). For k = i and I = j, we use 
simplified notation A(i,j) = A(i, j,i, j), for i,j 6 J. Matrix M is an a-Monge matrix if and only 
if A(i,j, k,l) > for all i < j and k < I, and M is permuted a-Monge if and only if there exists a 
permutation tt such that A(i,j, k, 1,tt) > for all i < j and k <l. It is easy to check that 

A(i,j,k,l)= A(s,s + l,t,t + l). (1) 

s=i,...,j—l;t=k,...,l—l 

Therefore, given a permutation tt and matrix M, it can be checked in 0(n 2 ) time whether tt is an 
a-Monge permutation for the matrix M. 

We will say that row (column) s is equivalent to row (respectively, column) t, if A(s, t, k,l) = 
(respectively, A(k, I, s, t) = 0) for all k, I. It can easily be shown that if rows s and t are equivalent, 
then M(s,i) = M(t,i) + a s t, for all i and some constant a s t- Hence, after subtracting a s t from all 
elements in the row s (M'(s,i) = M(s,i) — a s t), one gets two identical rows s and t (M'(s,i) = 
M'(t,i) for all i). A matrix with all rows (and all columns) equivalent is called a sum matrix: It 
can be shown that in this case M(s,t) = u s + vt, for some real vectors u and v. Clearly, any sum 
matrix is a-Monge. 

A.l Reducing the size of matrices 

We will first show that whenever an n x n matrix M is not a permuted a-Monge matrix, then 
there exists a set of indices B with \B\ < 4 such that M[B] is a bad matrix. Our approach to 



20 



k j 



A(i,k) = 


A(i,k,k,j) 


A(k,j,i,k) 


A(fc,i) = 



Figure 3: Schematic representation of submatrices and algebraic sums A. 

the recognition of bad matrices is loosely based on the COM (Construct partial Orders and Merge 
them) algorithm, suggested in [T2|. This algorithm constitutes a general approach to deciding 
whether a given matrix, possibly with some unknown elements, can be permuted to avoid a special 
set of 2 x 2 submatrices. In our case, these are submatrices M[{i, j, k,l}} with A(i,j,k,l) < 0. 

We will use the idea of the COM algorithm, which goes as follows: given a matrix M, we 
try to construct an a-Monge permutation for it. We start with a pair of indices which 
correspond to two non-equivalent rows or columns in the matrix. We assume further that the index 
i precedes index j in an a-Monge permutation ir. The assumption i ~< n j determines the order 
of some other indices. Under the assumption that i j, the strict inequality A(i,j,k,l) > 
indicates that k ~< n I, while the strict inequality A(i,j,k,l) < indicates that I -< n k. (Note that 
A(i,j,k,l) = —A(i,j,l,k) = —A(j,i,k,l) = A(j,i,l,k) - this property will often be used in our 
proofs). The obtained information can be conveniently represented as a directed graph Pm with 
nodes J and directed arcs corresponding to the identified precedence constraints together with the 
initial constraint i -< n j. We then extend Pm recursively to obtain additional information about the 
ordering of indices. Eventually, either Pm contains an oriented cycle which signals that the matrix 
is not a permuted a-Monge matrix, or we can view Pm as a partial order. This order defines a set of 
permutations (i.e., linear extensions of Pm) which are our candidates for an a-Monge permutation. 
We illustrate the COM approach with the following example. 

Example A.l Consider a submatrix M[{i, k, j}]. Schematic representation of this sub-matrix and 
algebraic sums A is shown in Fig. El We claim that, provided A(i, j) = A(i, k) = A(k,j) = 0, the 
submatrix is either a bad matrix or a sum matrix. 

It follows from A(i,j) = A(i,k) + A(i, k, k,j) + A(k,j,i,k) + A(k,j) = that A(k,j,i,k) = 
—A(i,k,k,j). Suppose that A(k,j,i,k) ^ and A(i,k,k,j) ^ 0. Without loss of generality, 
suppose that i -< k in an a-Monge permutation and that A(i, k, k,j) > 0. The assumption that row 
i precedes row k, together with the inequality A(i,k,k,j) > yields k -< j. The assumption that 
column i precedes column k together with the inequality A(k,j,i,k) > yields a contradictory 
precedence j -< k. Therefore M[{i,j, k}] is a bad matrix. 

If A(k,j,i,k) = and A(i,k,k,j) = 0, then it can easily be shown that M[{i,j,k}] is a sum 
matrix. □ 

We recommend the reader to use diagrams like the one in Fig. |21 in the following proof, since 
they make arguments more transparent. 

Theorem A. 2 If an nx n matrix M is not a permuted a-Monge matrix, then there exists a set of 
indices B with \B\ < 4, such that M[B] is a bad matrix. 
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Proof: We can without loss of generality assume that M has no pair s, t of indices such that 
both rows s, t are equivalent and columns s, t are equivalent. Indeed, if s, t is such a pair then it is 
easy to see that M is permuted a-Monge if and only if M[J \ {s}] is permuted a-Monge, so we can 
delete row s and column s and continue. 

First note that if there exists a pair i,j such that i ^ j and A(i,j) < 0, then M[{z, j}] is a bad 
matrix, so we assume further on that A(i,j) > for all distinct 

Assume that A(i,j) = for all Suppose that there exists a triple k such that 

A(k,j,i,k) 7^ and/or A(i,k,k,j) ^ 0. Then, as shown in the example above, M[{i,j,k}] is 
a bad matrix in this case. Suppose instead that A(k,j,i,k) = and A(i,k,k,j) = for all i,k,j. 
For any s,t,k,l with s,t < k,l, we have A(s,t,k,l) = A(s,i, i,Z) — A(s,t,t,k), and therefore 
A(s, t, k, I) = 0. For any s, t, k, I with s,t > k, I, we have A(s, t, k, I) = A(s, t, k, s) — A(s, t, I, s), 
and therefore A(s, t, k, Z) = 0. It can be shown in a similar way that A(s, t, k,l) = for all s, t, k, Z, 
and therefore M is a sum matrix, which is impossible because M is not permuted a-Monge. 

Assume now that maxj. ; A(k, I) > 0. We will try to construct an a-Monge permutation for M, 
and show that such an effort unavoidably results in the identification of a bad submatrix in M. 
If M were a permuted a-Monge matrix, then there would exist indices i*,j* and a permutation 
7T with 7r(i*) = and 7r(j*) = n — 1 such that A(i*,j*) = max^; A(fc, I) (see equation (^1), and 
also A(i*,j*,j,j + 1, 7r) > and A(j,j + l,z*,j*,7r) > for all j = 0, l,...,n — 2. To simplify 
the presentation, we assume that i* = and j* = n — 1 (otherwise, we renumber the rows and 
columns in the matrix). The above inequalities can be rewritten as M(0, — M(n — 1, vr(j')) > 
M(0,7r(j + l))-M(n-l,vr(j+l)) and M(vr(j), 0)-M(tt(j), n-1) > M(vr(j+1), 0)-M(7r(j+l), n-1) 
for j = 0, 1, ... ,n — 2. 

So, an a-Monge permutation ir would have to sort the differences (M(0, i) — M(n — 1, i)) and the 
differences (M(i,0)— M(i,n— 1)), i ^ 0, n — 1 in non-increasing order. If there exists no permutation 
that sorts both sequences, then there is a pair i,j such that M(0, £) — M(n — < M(0,j) — M(n — 
(which yields the precedence constraint i -< j) and M(i,0) — M(i,n— 1) > M(j, 0) — M(j, n — 1) 
(which yields the precedence constraint j -< i). This implies that matrix M[{0, n — 1, i, j}] is a bad 
matrix. 

Suppose now that A(0, n — 1) = max^z A(fc, /) and there exists a permutation ir, with 7r(0) = 
and 7r(n — 1) = n — 1, that sorts both sequences. Fix such a permutation and permute M according 
to it. We can without loss of generality assume that M had this new form from the very beginning, 
that is, both the sequence (M(0, i)— M(n— 1, i)) and the sequence (M(i, 0)— M(i, n—1)), i ^ 0, n—1, 
are already in non-increasing order. 

Since M is not permuted a-Monge, we still have indices p, q, s, t such that p < q, s < t, and 
A(p,q,s,t) < 0. It follows from the inequality A(p,q, s,t) < and from the equation that 
there exists an index i with p < i < q — 1, and an index k with s < k < t — 1, such that 
A(i, i + 1, fc, A; + 1) < 0. We consider the case i < k: the case i = k is already eliminated and the 
case i > k is symmetric. 

Assume that there exist indices i and k with i + 1 < k such that A(i,i + l,k,k + 1) < 0, 
A(i, i + 1, 7 + 1, k) > 0, and A(i + 1, fc, fc, fc + 1) > 0. We claim that M[{i, i + 1, A;, k + 1}] is a bad 
matrix in this case. Indeed, the assumption % -< 7 + 1 yields 7 + 1 -< A; and A; + 1 -< A;, and constraint 
k + 1 -< k for the columns k and A; + 1 yields k ~< i + 1. This proves the claim. 

Assume now that these is no pair of indices i, k with i + 1 < k such that A(i, i + l,k,k + l) < 0, 
A(i, 7 + 1, 7+ 1, k) > 0, and A(i + 1, k, k, k+1) > 0. We claim that then there exists a triple of indices 
i,j, I with 7 < j < I such that A(i,j,j, I) < 0. Indeed, we know that we have a pair of indices i, k 
with i < k such that A(i, 7 + 1, A;, k + 1) < 0. If % + 1 = k, then our claim trivially holds with j = k 
and Z = A;+l. Otherwise, we have i + 1 < k with A(7, 7+1, 7+1, A;) < or A(7 + l, k, k, A;+l) <0 (or 
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both). If A(i,i+l,i+l, k) < then A(i,i+l,i+l, fc+1) = A(i, fe)+A(i,i+l, fc, fc+1) < 0, 

so we can take j = i + 1 and / = fc + 1 in our claim. The situation when A(z + 1, k, k, k + 1) < is 
treated similarly. 

We consider two cases: 

Case 1 There exists a triple i < j < I with A(i,j,j,l) < such that i = or I = n — 1, or 
both. 

We consider the case with A(Q,j,j,l) < (the case of A(i,j,j,n — 1) < is symmetric). We 
claim that matrix M[{0,j, l,n — 1}] is a bad matrix in this case. Indeed, rows and columns 
in the matrix are sorted to guarantee, in particular, the inequalities A(0, n — l,j,l) > 
and A(0, j, 0, n — 1) > 0. It follows from the assumption A(0, j,j,l) < and the equality 
A(0, n— l,j, I) = A(0, j, j, l)+A(j, re— 1, j, I) that A(j, n— 1, j, I) > 0. So, the assumption -< j 
yields I -< j, and I -< j yields n — 1 -< j. We will show that then we have a contradiction with 
the choice of and n — 1 as a pair such that A(0, n— 1) = max^; A(/c, Z). If / = n — 1 then there 
are two permutations of {0,j, n — 1} compatible with the obtained precedence constraints: 
(0,n— l,j) and {n— 1, 0, j). If (0, n — is an a-Monge permutation for M[{0,j, n — 1}] then 
A(0, j) can be represented as a sum of non-negative numbers (see equality (fT)l) which include, 
in particular, A(0, n — 1) and A(n — 1, j) > 0. This is a contradiction with the choice of and 
n—1. If (n— 1, 0, j) is an a-Monge permutation for M[{0, j, n— 1}] then we get a contradiction 
in a a similar way, using the fact that A(0, j) = A(0, j, 0, n — 1) — A(0, j, j, n — 1) > 0. 

Assume further on that I ^ n - 1. Since A(0,j, j, /) < and A(0,j, 0,n — 1) (= A(0,j) + 
A(0, j, j, /) + A(0,j,l,n — 1)) > 0, there are only three possibilities for the values of A(0, j) 
and A(0,j,/,n-l)): A(0,j) = and A(0, j,Z,ra-l) > 0; A(0, j) > and A(0,j, I, n- 1) = 0; 
A(0,j) > and A(0,j,l,n — 1) > 0. We consider each of these cases in turn and show that, 
for all of them, we have a contradiction with the choice of and n — 1. 

Subcase 1.1 A(0, j) = and A(0, j, I, n - 1) > 

In addition to the previously stated precedence constraints -< j, I -< j, and n — 1 -< j, 
we also have I -< n — 1 (since A(0,j, Z,n — 1) > 0) and / -< (since A(0,j, 0, 1) = 
A(0,j) + A(0,j, j, I) < 0). This gives two possible permutations for permuting the 
submatrix M[{0,j, l,n — 1}] to an a-Monge matrix: (Z,0,n — l,j) and (l,n — 1,0, j). If 
the matrix obtained after permuting rows and columns of M[{0,j, l,n — 1}] according to 
0, n — 1, j) is indeed an a-Monge matrix, then the value A(l,j) can be represented as a 
sum of non-negative numbers (see equality (^)) which include, in particular, A(0, n — 1) 
and A(0,j,/,0) = -A(0, j,0,Z) > 0. This means that A(l,j) > A(0,n - 1), which is a 
contradiction with the choice of and n—1. For the second permutation, the value A(l,j) 
is represented as a sum of non- negative numbers which include A(n — 1, 0)(= A(0, n — 1)) 
and A(0, j,l,n - 1) > 0. This also yields A(l,j) > A(0,n - 1). 

Subcase 1.2 A(0, j) > and A(0, j, I, n - 1) = 

In this subcase, we have A(j, n — 1, 1, n — 1) > (since A(0, n — 1, 1, n — 1) = A(0, j, l,n — 
1) + A(j, n — 1,1, n — 1) > 0), and therefore A(j, n — 1) = A(j, n — l,j, I) + A(j, n — 
1,1, n — 1) > (since A(j, n — 1, j, /) > 0) . The initial precedence constraints {0 -< j,l -< 
j,n — 1 -< j} imply that, in a-Monge permutation for M[{0,j, Z,n — 1}], we must have 
either -< n — 1 -< j or n — 1 -< -< j. In the former case, the value A(0,j) can be 
represented as a sum of non-negative numbers including A(0, n — 1) and A(n — l,j) > 
(see equality ©), and hence A(0, j) > A(0, n—1) which is a contradiction with the choice 
of and n — 1. In the latter case, we similarly get A(n — 1, j) > A(n — 1,0) + A(0, j) and, 
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since A(0, j) > by the assumption of Subcase 1.2, we obtain A(n — > A(0, n — 1). 
Therefore, it follows that M[{0,j,l,n — 1}] is a bad matrix. 

Subcase 1.3 A(0, j) > and A(0, j, I, n - 1) > 

There are three potential a-Monge permutations for M[{0,j,l,n — 1}]: (0,l,n — 
{l,0,n — l,j), and (l,n — 1,0, j). As in the previous subcase, one can show that if one 
of them is an a-Monge permutation for M[{0, j,l,n — 1}] then there is a contradiction 
with the choice of and n — 1. 

Case 2 For any triple i,j, I, i < j < I, with A(i,j,j, I) < 0, neither i = nor I = n — 1. 
It is easy to see that this condition implies the following inequalities: 

A(0, I) > because, otherwise, A(0, I) = A(0,i,j,l) + A(i,j,j, I) < 0; 
A(i,j,l,n—1) > because, otherwise, A(i,j,j,n — 1) = A(i,j, j, I) + A(i, j, Z, n — 1) < 0; 
A(j,/,/,n-l) >0; 

A(o,M,i) >o. 

We claim that, given the above inequalities, at least one of M[{0, i, j, I}] and M[{z, j, l,n — 1}] 
is a bad matrix. 

We show first that if A(j,l) = 0, then M[{0, I}] is the bad matrix. Indeed, when trying 
to find an a-Monge permutation for this matrix, the assumption -< i yields j -< I (since 
A(0, I) > 0) and i ~< I (since A(0, I) = A(0, + A(0,i, j, I) > 0). The constraint 

j ~< I for the columns yields the constraint j -< i, and, since A(i, l,j, I) = A(i,j,j, Z) + A(j, I) = 
A(«, j, j, I) < 0, it also yields I -< i. The contradictory precedence constraints {I -< i,i -< 1} 
prove that M[{0, I}] is a bad matrix. So, we assume now that A(j,l) > (the case 
A(j,l) < is already eliminated). 

By using a similar argument for the matrix M[{i,j,l,n — 1}]), we see that that if A(i,j) = 
then this matrix is bad. So we will also assume that A(i,j) > 0. 

We now consider the submatrix M[{0,i,j, I}] and will try to permute it into an a-Monge 
matrix. The assumption -< i yields j -< I, % -< I, j -< i. Since A(i,j) > 0, and so 
A(0, j, = A(0, i, i, j) + A(i, j, i, j) > 0, we also have j -< 0. This shows that a permutation 
other than (j,0,i,l) cannot be an a-Monge permutation for M[{0,i,j,l}]. By analyzing the 
matrix M[{i, j, I, n— 1}] in a similar way, we see that the only potential a-Monge permutation 
for it is the permutation (i,l,n — 1, j). 

If (j,0,i,l) is an a-Monge permutation for M[{0,i,j, I}] then we must have A(0, i,j, 0) > 
0. Since A(0, > by the assumption of Case 2, and also A(0, i) > 0, we have 

A(0,»,0,j) = A(0,z,0,z) + A(Q,i,i,j) > 0. However, A(0,i,0,j) = -A(0,i, j,0), which 
implies that A(0, i) = and A(0, = 0. 

Moreover, if (j,0,i,l) is an a-Monge permutation for M[{0,i, j,l}] then A(j,i,i,l) > 0. Sim- 
ilarly, if (i,l,n — l,j) is an a-Monge permutation for M[{i,j,l,n — 1}] then A(i,j,i,l) > 0. 
But A(j,i,i,l) = —A(i,j,i,l), so both are equal to 0. 

If (j,0,i,l) is an a-Monge permutation for M[{0, I}] then we must have A(J,0,i,l) > 0. 
We can express A(j,0,i,l) as A(j,0,i,l) = —A(0,j,i,l) = —(A(0,i,i,j) + A(0, i, j, I) + 
A(i,i) + A(i,j,j,l)). Since A(0, i,i,j) = and A(i,j) + A(i,j,j,l) = A(i,j,i,l) = 0, we 
get A(0, I) = —A(j,0,i,l) < 0. However, the inequality A(0,z,j, I) > is one of the 
four inequalities (see above) directly implied by the assumption of Case 2. Hence, we get a 
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contradiction which proves that at least one of the matrices M[{0, i, j, I}] and M[{i, j, I, n — 1}] 
is a bad matrix. 

This completes the proof of the theorem. 

□ 

Note that the bound \B\ < 4 in the above theorem is tight. Indeed, it can be straightforwardly 
checked that the following matrix is not permuted a-Monge, while any matrix obtained from it by 
deleting a row and a column (with the same index) is permuted a-Monge. 



/ 1 


1 





1 \ 


1 


1 




















1 1 








1 1 



We can now derive the main result of this section from Theorem IA.21 

Corollary A. 3 Let Mi, . . . , M m be n x n matrices. If there exists no permutation that simulta- 
neously permutes all these matrices into a-Monge matrices, then there exists a subset of indices 
B with \B\ < 4, such that no permutation of the indices in B simultaneously permutes matrices 
All [B] , • • • , M m [B] into a-Monge matrices. 

Proof: Consider the matrix M = Y^iLi-^i- ^ M is not a permuted a-Monge matrix then, 
by Theorem IA.21 there exists a subset of indices B with \B\ < 4, such that M[£?] is a bad ma- 
trix. Consider matrices Mi [5], . . . , M m [B\. If there existed a permutation that permutes all these 
matrices into a-Monge matrices, then the sum of the permuted matrices, which is M[5], would 
be an a-Monge matrix as well. This contradiction proves that there exists no permutation that 
simultaneously permutes matrices Mi[JB], . . . , M m [B] into a-Monge matrices. 

Assume now that M is a permuted a-Monge matrix. The corresponding a-Monge permuta- 
tion does not permute Mi, . . . , M m into a-Monge matrices. Hence, there exist indices k, I and 
a pair of matrices, say, Mi and M2 such that M\{i,k) + Mi(j,l) — M\(i,l) — M\(j,k) > and 
M 2 (i,k) + M 2 (j,l) - M 2 (i,l) - M 2 (j,k) < 0. This implies that the matrices Mi[{i,j,k,l}] and 
M 2 [{i, j, k, I}] cannot be simultaneously permuted into a-Monge matrices - this follows from the 
fact that the assumption i -< j implies k -< I for Mi and I -< k for M 2 . □ 

A. 2 Reducing the number of matrices 

We will now prove the bound < 3 in Proposition E31 again via a-Monge matrices. In the proof, 
we will use special partial orders which we call multipartite partial orders. 

We say that a partial order ^ on a set D is multipartite if and only if there is a partition of 
D = Di U . . . U D t , t > 2, such that d X d' if and only if d = d! or else d E A and d' G Dj 
for some 1 < i < j < t. If P is a multipartite order, then we will call the classes D\, . . . ,Dt the 
corresponding partition classes of P. 

It is clear that if it is an a-Monge permutation, for a matrix M then the reverse permutation 
7r~ is also an a-Monge permutation for M. It is also clear that if M is a-Monge and the matrix 
obtained from M by simultaneously swapping rows s and t and columns s and t is again a-Monge 
then rows s and t are equivalent, i.e., M(s,i) = M(t,i) + a s t, and columns s and t are equivalent 
as well. Note that swapping of equivalent rows and columns does not affect the property of being 
a-Monge. A matrix M is called Monge if — M is a-Monge. It is shown in Observation 3.6 of 36 
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that if M is Monge, i -< j -< k in M, and rows (columns) i, k are equivalent in M then row j 
is equivalent to these rows (columns). Clearly, the statement is also true for a-Monge matrices. 
Theorem 3.9 of [HS] states that if a Monge matrix has no equivalent rows or columns then the only 
way to permute it to a Monge matrix is by using either the identity permutation id or its reverse 
id~ . 

This leads to the following characterization of a-Monge permutations in terms of multipartite 
orders. For every anti- Monge square matrix M, there exists two mutually reverse multipartite 
orders such that a permutation (i.e. ordering) of the indices of M is an a-Monge permutation if 
and only if this ordering is an extension of one of the two multipartite orders. Two indices i,j 
belong to the same partition class of such a multipartite order if and only if both rows i,j and 
columns i,j are equivalent in M. 

We will now prove two auxiliary lemmas about multipartite orders. 

Lemma A. 4 For any two multipartite orders P' and P" on D, there are a,b G D such that a and 
b are comparable (not necessarily in the same direction) both in P' and in P" . 

Proof: Take a maximal chain in P'. If it is not entirely contained in a class of P" then there 
are two elements in this chain belonging to two different classes of P", that is, these elements are 
comparable both in P" and in P' . If all elements in the maximal chain are contained in the same 
class of P", then pick any element d in a different class of P" . This element is comparable, in P", 
with all elements from the chain, and, clearly, it is comparable with at least one of these elements 
in P'. □ 



Let us say that a collection V = {Pi, ... ,P{\ of multipartite orders is conflicting if their union 
(considered as a digraph G-p) contains a directed cycle. 

Lemma A. 5 If a collection V = {Pi, . . . , P{\ is conflicting then the digraph G-p contains arcs (a, b) 
and (b, a) for some distinct a, b. 

Proof: Let a±, . . . ,at,a\ be a shortest directed cycle in G, and assume, for contradiction, that 
t > 2. Without loss of generality, let (01,02) G P\. In this case, (02,03) g" Pi, since, otherwise, 
we would have (01,03) G Pi and get a shorter cycle. Without loss of generality, assume that 
(02,03) G Pi- Since the order Pi is multipartite, we conclude that ai and 03 are comparable in 
Pi. Furthermore, since we cannot have (01,03) € Pi, we have (03,01) G Pi. Since (01,02) G Pi, 
the transitivity of Pi implies that (03,02) G Pi, which, together with (02,03) G P2, gives us the 
required arcs. □ 



Proposition A. 6 Let U = {Mi, . . . , M m } be a set of matrices of size n x n such that no permu- 
tation is an a-Monge permutation for all matrices in U . Then, there is a subset U' C U such that 
\U'\ < 3 and no permutation is an a-Monge permutation for all matrices in U' . 

Proof: We may assume that every matrix in U is a permuted a-Monge matrix, since, otherwise, 
the result follows immediately. Start with matrix M\ G U and choose any of the two multipartite 
orders that describe the set of corresponding a-Monge permutations for M\. Call this order Pi. By 
Lemma lA.4| there is a pair (a,b) G Pi such that o / i and a and b are comparable in P2, where 
P2 is the multipartite order for Mi. We may assume that (a, b) G Pi, since, otherwise, the other 
multipartite order for P2 would be chosen. 
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If there is a pair of distinct elements (c, d) such that (c, d) € Pi and (d, c) € P2 , then there exists 
no a-Monge permutation for Mi and M2 and the proposition is proved. So we may assume that 
{Pi,P 2 } is not conflicting. Since Pi shares a pair of comparable elements with any multipartite 
order, we can in the same way choose a multipartite order Pj for each matrix Mj. If, for some i, the 
pair {Pi, Pi} is conflicting, then the proposition is proved. So assume that all such pairs of orders 
are non-conflicting. Note that if we chose the other multipartite order for M\ , this would have led 
to choosing the other multipartite orders for all M\ , . . . , M m . 

Since there is no common a-Monge permutation for all of Mi, . . . , M m , we know that the col- 
lection {Pi, . . . ,P m } of orders that we have constructed is conflicting. By Lemma lA.5| there are 
orders Pj and Pj such that, for some distinct e, /, we have (e, /) £ Pi and (/, e) £ Pj. Since both 
Pi and Pj share with Pi some pairs of elements comparable in the same direction, we conclude that 
there is no common a-Monge permutation for M\, Mi, Mj. This completes the proof. □ 

Note that the bound \U'\ < 3 in the above proposition is tight. Indeed, each of the following three 
matrices is permuted a-Monge, every two of them have a common a-Monge permutation, but there 
is no common a-Monge permutation for all three of them. 

1 \ / \ / \ 
000 010 000 

000/ \ / \ 1 / 



Appendix B: Strict implementations from Case 1 

It is assumed throughout that D = {0, 1, 2, 3}. Implementations should be read as follows: 

• the symbol =^ a means "strictly a-implements" ; 

• U always denotes Ud] 

• Y = {x, y} is the set of primary variables and Z = {z, w} is the set of auxiliary variables (see 
Definition EZQ). 

Each implementation produces some predicate g such that either g or 7r(g), or Tr(g c ) (for some 
permutation ir) is a predicate for which a strict implementation has already been found, or else a 
predicate g such that, for some D' C D, g\D> is not supermodular on any chain on D' . We will 
describe the latter situation by writing, for simplicity, that ll g\D' is bad". If \D'\ = 2 then one can 
directly verify that the corresponding matrix is not a-Monge (there is no need to permute rows and 
columns). For the case \D'\ = 3, one can use Lemma 14.41 to quickly check that the matrix of g\r>' 
is not a permuted a-Monge matrix. 

1000 ^ 1000 

-, J j / 0110 I , , , . s 1110 . . , , 

I- <h 1 := 1000 UW=^ 2 1[|00 =: g 9\{o,i,3} is bad 

0000 J 0000 
g{x,y) + 1 = max z [hi(z,y) + h' x {x,z) + u {3 y(z)} 

!1000 ^ 1000 
t / 1101 I , , 7 . s 1101 , . , , 

" 2 ;= 1000 f u "=^3 101Q =-g 3l{o,2,3} is bad 
0000 J 0000 

g(x,y) + 2 = max z [h' 2 (z,x) + h' 2 (z,y) + h' 2 (x,y) + u {3} (z) + u {2} (x) + u {2 }{y)] 
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3. < h' 3 := 

g(x,y) + 3 



1001 
0111 



1000 
0111 



( U U 1110 



= : 9 .9l{o,i,3} is bad 
1001 ) 0001 

max z [h' 3 (z, x) + h' 3 (z, y) + h' 3 (x, y) + u {1)2 }(z)] 



4. ( h' A : 



1010 ] 1101 
0101 I 7 . s 0101 
1010 [ ^ 4 1000 
1000 J 0101 

y) + 3 = max ZtW [h' i (z, w) + h' A {z, y) + h' A {w, x) + U{i, 3 }(z)] 



.9 5l{o,i,2} is bad 



1010 
0110 
0000 
0000 



)■ u u 



1000 
0100 
0001 



.9 5l{o,i,3} is bad 



5. (h' 5 := 

g(x,y) + 2 = max z [h' 5 {x,z) + h' 5 (x,y) + h' 5 (y,z) + u {3} (z) + u {2 ^ } (x) +u {3} (y)] 



0001 



g(x,y) +3 



1010 
0111 



1010 
0111 



( u U 1010 



.9 .9l{o,i,3} is bad 
1000 ) 1001 

= max z [h' 6 (x, z) + h' e (x, y) + h' e (y, z) + u {2} (z) + u {3} (x) + u {3} (y)} 



7. < 



h' 7 :-- 



1010 
0111 



1110 
0000 



( u u ==>3 0000 



9(x,y) + 2 



8. ( h' s := 



= : .9 51(2,3} is bad 

1000 J 1010 

max z [h' 7 (z,y) + h' 7 (x,z) + u {0 ^ 3} (x)} 




1010 
0000 
1010 
1011 



.9 .9l{o,i,3} is bad 



g(x, y) + 5 = maa^^g^u/) + h' s (z,x) + h' 8 (z,y) + h' s (w,x) + u {2 y(z) + u{ }(w) + u {1 ^ 3 y(x)] 

g 5l{o,i,2} is bad 



9. <tig : 



1001 
0101 



9(x,y) + 2 

10. L' 10 := 

9(^,y) + 2 

11. J h' :-- 



1011 
0111 

0010 i 3 0010 

0000 J 1101 

= max z [h' g (z, x) + h' Q (x, y) + h' 9 (y, z) + u {3} (z) + u {3} (x) + u {3} (y)} 



1011 
0111 
0010 
0001 



u u 



1011 
0111 
>3 0010 
0000 



--■ 9 9 = K 



max z [h' 10 (z,x) + h' w (z,y) + u {2 }(z) + u {0 ,i}(x)} 



1011 
0111 
0011 
0000 



u u 



1000 
0100 
>2 0000 
1100 



g 7r( ff 4 ) = h' 5 where tt(0, 1, 2, 3) = (0, 1, 3, 2) 



g(x,y) + 1 = h' n (x,y) +u {3} (x) +u {0 ^ } (y) 
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12. < h' 12 := 



g(x, y) + 2 = max z 



1011 ^ 0110 

0111 { , , 7/ JL^ 0111 i ■ u J 

0110 f uW =^3 oln =:.9 5l{o,i,3} is bad 

1001 J 0000 

[^'ufo J/) + K 2 (x, z) + u {ia} (z)} 



13. < h' 13 := 



1011 "1 
0111 
1010 
0000 

g(x,y) + 2 = max z [h[ 3 (z, x) + 



UW=* 3 101Q 
0000 



1011 
0101 



u {3}(y)] 



14. < h' 14 := 



1010 
0001 

g(x, y) + 2 = mai 



19. ( h' 



19 



20. L 20 := 
5(^)2/) + 1 



1011 ^ 0001 

OlH I u jj±± 0111 _. 
1010 I 3 0000 

0001 



=: 9 9 = K 

0000 

K3 (x,y) + K 3 {y, z) + u {3} (z) 

= h' 2 where tt(0, 1, 2, 3) = (3, 1, 0, 2) 



: 9 



. J 0001 

z[K 4 (z, y) + h[ 4 (x, z) + u { i )3 }(z)] 



15. |h' 16 := 

s(x,y) + 3 = 

16. L' 16 := 
ff(a>2/) + 3 = 

17. L' 17 := 

g(x,y) + 3 = 

18. L' 18 := 

g(x,y) + 4 = 



1011 1011 
0111 I . 0101 , 

1110 f U U 1010 =: 3 5 = h * 

) J 0000 

z [/i' 15 (x, z) + h' 15 (x,y) + h' 15 (y, z) + u {Q ^ 3} (z) + u {3} (x) + u {3} (y)} 



1110 
0000 

maxz 



1011 
0000 

>i 10U 9 ,9l{o,i,3} 
0001 



is bad 



. J 0001 

z [/i' 16 (z, x) + h' 16 (z, y) + h' w (x, z) + w {0 ,3}0)] 



1010 

, 7 ,s 0111 
U LA ==> 4 lno — : .9 9l{0,i,3} 



1011 
0111 
1110 
1001 , 

max z [h' 17 (z, x) + h" 



is bad 




0001 

y) + u {h2} {z)} 

is bad 



1110 

. 7 . s 0000 
U LA =^ 5 lno =: .9 5|{1,3} 

1110 

[h' 18 (z,w) + h' 18 (z,y) +h' 18 (w,x) + u {h2} (z) +u {0} (w)} 



1011 



1010 



1010 
0000 

: max z 



is bad 



1101 I i , ii jL^ 1011 

> UW =^ 5 101Q =:g 9\{i,3} 

J 1010 

iW [ft' 19 (z,u;) + h' 19 (z,y) +h' w (x,z) +u {2} (z) +u {2} (w) +u {1 , 3} (x)} 

1100 ^ 1110 

HOI I . . j. - noi 
1000 j 2 1011 

0000 J 0111 

^20 fa, J/) + ^20^! =0 + w {2,3}(a;) + w {2 ,3}(y) 



=: <? tt( 5 ) = h' ls where tt(0, 1, 2, 3) = (0, 3, 1, 2) 
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21. < h' 21 := 



g(x,y) + 5 



1101 
0110 



1001 
1101 



( u U = ^ 6 oooo : 9 



fll{o,i,2} is bad 
1001 ) 1001 

max z , w [h' 21 (z,w) + h' 21 {z,x) + h' 21 (z,y) + h' 21 (w, x) + u {3} (z) + u {0} (w) + u {ia] (x)] 



22. { h 



22 



1101 ^ 
1100 
0010 
0000 



)■ u u 



1000 
1110 
0010 
1010 



g nig 1 ) = h' g where tt(0, 1, 2, 3) = (0, 2, 1, 3) 



g(x,y) + 2 = max z [h' 22 (x, z) + h 22 (y, z) + U{ 2 ,3}0) + u {li3} (x)] 



23. < h' 23 := 



1101 1101 

mo I U1J ±^ mo 
oooo i 2 0111 

0000 J 1011 
g(x,y) + 1 = h' 23 (x,y) + h' 23 (y,x) + u {2 ^ 3} (x) +u {2i3} (y) 



=: g tt( 9 ) = h' ls where tt(0, 1, 2, 3) = (0, 2, 1, 3) 



24. ( h' 24 := 



1101 
1110 



1001 
1101 



0110 f UW ^6 qqqq -.9 .9l{o,i,2} is bad 



1001 ) 1001 

ff(ar,2/) + 5 = ma2i 2iffi [/i^^ii)) + h' 24 (z,x) + h' 2i (z,y) + h' 24 (x, z) + u {3} (z) + u {3} (w) + u {lj2 }(a;)] 



25. < h' , := 



U U 



oooo 

1101 



1110 
1100 

oooo 

0000 J 0001 
g{x,y) + 1 = h' 25 (x,y) + u {1 ^ 3] (x) + u {3] (y) 



0001 



=: g nig') = K where tt(0, 1, 2, 3) = (1, 3, 0, 2) 



26. 4 /i' := 



g(x,y) + 1 



1110 oooo 

1100 I , , a 1101 

1010 \ ulA 

0000 J 0001 

h' w i. x ^y) + U{i,2,3}{x) + u {3} (y) 



>2 ion - :9 



Tr{g) = h'g where tt(0, 1, 2, 3) = (1, 2, 3, 0) 



27. < h' 27 :-- 

g(x,y) + 1 




U U 



0110 
0101 
>2 0010 
0111 



g nig 1 ) = h' 13 where tt(0, 1, 2, 3) = (1, 2, 3, 0) 



Appendix C: Strict implementations from Case 2 

The rules for reading implementations are the same as in Appendix B. Each implementation im- 
plements some predicate g such that, for some D' C D, g\r>i is bad, or else a pair for which a strict 
implementation has already been found. 

1100 1000 ^ 1000 

0000 , 0001 , , 7/ 8 1101 , . , , 
:= 0000 0000 f UW ^3 0Q00 =:g g|{o,i,2} is bad 

0001 0001 J 0101 

g(x, y) + 2 = max z [f(x, z) + f(y, z) + h(z, x) + u {1] (z) + u {lj2} (x)} 
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1000 

' UU ^3 0000 = :g .9) is Pair 1 

0001 



0101 

• u u ^ 4 0000 =: 9 g ^ is bad 

0101 



1000 

' uw ^ 2 1000 =:g isPair3 

0001 



1000 

>uw ^ 2 1000 =:g isPair3 

0001 



1100 


1110 


0000 
0000 ' ■' 


_ 0001 
' — 0000 


0001 


0001 


= max z 


f(x,z) + 


1100 


1000 


0000 , 
0000 ' ■* 


1001 
'~ 1000 


0001 


0001 


= max w 


,z[f(z, w] 


1100 


1010 


0000 , 
0000 ' ■* 


1010 
' — 1010 


OOU1 


nnm 
UUU1 


= max z 




1100 


1010 


0000 , 
0000 


1011 
'~ 1010 


0001 


0001 


= TTlCLXz 


fix z) 4 


1100 


1110 


0000 , 
0000 


0001 
:_ 1110 


0001 


0001 


= max z 


f(z,x) + 


1100 


1010 


0000 , 
0000 ' J 




h- 1 h- 1 


0001 


0001 


= f(Vi x 


) + «{1}( 


1110 


1010 


0000 , 

0001 ' ^ 


0001 
: ~ 0001 


0001 


0001 


= max z 


/(*,») + 


1110 


1000 


0000 , 

0001 '■' 


0001 
: ~ 1001 


0001 


0001 



1010 

>uw ^ 3 1010 =; - 9 isPair4 

0001 



1000 

' uw ^ 2 1000 =; - 9 isPair3 

0001 



1000 

>UWJ= ^ 3 0101 =:g 5l{o,i,2} is bad 
0101 



1010 

0000 , . , , 

U U =^2 onl =: .9 ffl{o,i,2} is bad 

0111 

g(x, y) + l = max z [f(y, z) + h(x, z)\ 

1010 

• yW ^4 0001 =' g (M is Pair 6 
0001 



11. { 



1110 


1010 


0000 
0001 


, . 0101 
'J : ~ 0101 


0001 


0101 


= max z [f(z,y) + 


1110 


1000 


0000 
0001 


, . 0101 
'J : ~ 1101 


0001 


0101 



1010 

h:= nnm 11m ^ uM ^ =; g ffl{o,i,a} is bad 



0111 
0111 

g(x,y) + 2 = max z [f(y,z) + h(x, z) + u {0 ^ 3} (z)} 
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1110 1000 ^ 1000 

0000 , 1101 I « 0001 , > . . 
12 '^ := 0001 1101 f UW =^2 10Q1 =:<? (ft,<?) is Pair 9 

0001 0101 J 0001 

#0,2/) + 1 = f(y,x) + u {2} (x) + it {0 ,3}(y) 

1000 1000 ^ 1000 

1001 , 1001 I . . « 1101 , . , , 

13. ^h— 0001 ,/:= 1000 U«=^ 4 01Q1 = :g 9\{o,i,2} is bad 

0001 0001 J 0101 

j/) + 3 = max z [f(z, y) + f(y, z) + h(x, z) + u {3} (z) + «{o,i,2} (y)} 

1000 1010 ^ 1000 

1001 , 1011 I . . , . a 1001 , . „ . 10 

14. <ft:= 00Q1 ,/:= 101Q UM^ 3 1000 =: «? (ft, «?) is Pair 13 

0001 0001 J 0001 

l(x, y) + 2 = moi z [/(z, y) + f(x, z) + h(y, z)] 

1000 1010 ^ 1000 

1001 , 1011 , , 7/ 8 , 1001 \ • T> ' 1 Q 

15. <ft:= 000!,/:= 1011 > U W 100Q =: <? (ft, <?) is Pair 13 

0001 0001 J 0001 

g(ar,2/) + 1 = f(y,x) + u {1} (x) + u {0 ^ } {y) 

1100 1010 ^ 1100 

1101 , 1101 I . . s 0101 , . , , 

16. ^ft:= 00Q1 ,/:= 101Q UM^3 10U =:g <?| {0) i, 2 } is bad 

0001 0000 J 0101 

g(x,y) + 2 = max z [f(y,x) + h(z,y) + h(x, z) + u {3} (z)} 

1100 1100 ^ 1100 

1101 , 1100 I , , , . a 0100 , . , , 
l 0001 '■'^ 1011 ? u "=^4 oou =-g 9\{o,i,2} is bad 

0001 0000 J 0111 

g(x,y)+3 = max z [f(x, y) + h(x, z) + h(y, z) + u {3} (z) + ii {0 , 3 } (x)] 

1100 0000 ^ 0000 

1101 , 1101 I , . a 1011 , . , , 

1 0001 ^~ 1011 f uw =^4 1011 =■ g 9\{Q,i} is bad 

0001 0000 J 1011 

g(x,y) + 3 = max WiZ [f(w,y) + h(w,z) + h(x, z) + u {2 }{w)\ 

1100 1010 ^ 1010 

1101 , 0001 I , . a 1111 , . , , 
19 - \ h ' = 0001 ,/:= 1011 f UW ^2 01U =:<? 5l{o,i.2} is bad 

0001 0001 0111 



g(x,y) + l = max z [f(y, z) + h(x, z)} 



1100 1110 1010 

1101 , 0101 0001 \ • Ti> * in 
20. {h := 00Q1 ,/:= 000Q \yJU=^ 2 wn =: g (ft, 5 ) is Pair 19 



0001 0101 J 0001 

7(^,2/) + 1 = f{x,y) +u {2} {x) +M{ .2,3}(2/) 



1100 1010 ^ 1100 



, 1101 , 0101 I , . « 0111 , . , , 

h: = nooi 1010 u "^ 4 nooo =: » <?l {0,1,2} is bad 



21. < 

5(3, y) + 3 = Lf( z > + H x > z ) + Hy, z) + u {o,3} (*)] 



0001 ' J ' 1010 [ * 0000 
0001 0101 I 0111 
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1100 0000 ^ 1010 

1101 , 0101 I « 1101 , > . . 
22 -<* : = 0001 1011 f UW =^2 101Q =:<? (M) is Pair 16 

0001 0101 I 0000 



fl((ar,3/) + 1 = f(y,x) +U{ 0llj2 }(x) +u {0} (y) 



1100 0000 ^ 1100 

1101 , 1101 [,,,,», iioo 
23. \h:= 0001 ,/:= oon > U U =^ 2 lou =: 5 [h,g) is Pair 17 

0001 0011 J 0000 

s(x,y) + 1 = +u{ .i,2}(2 ; ) +"{o}(y) 

1000 0000 ^ 0000 

1001 , 1101 I , , o 1011 , . , , 
24 S h:= 1001 1011 f u ^=^ 10U =:g .9l{o,i} is bad 

0001 0000 J 1011 

g(x,y) + 3 = max w , z [f(z,w) + f(w,y) + h(x, z) + u {1 ^ 3} (z) + u {2 }(w)} 

1101 

}UU^ 4 }°°} =:g g\ {0A} is bad 
1101 



26. < 



1100 


1001 


1100 
1101 


, . 0100 
:_ 1101 


0001 


1001 


= max WiZ [f(z,y) - 


1100 


1101 


1100 
1101 


, . 0100 
: ~ 1101 


0001 


1001 



1001 

h: = itni'/ := iim ^ UW =^3 =: .9 (ft, 3) is Pair 25 



1101 
1001 

flf(a;,2/) + 2 = max z [f(z,x) + f(z,y) + M{i, 3 }(z) + W{ 2 }(x)] 
1100 1001 1111 

1100 , 0110 I , . « 1001 , . , , 

27 -S h:= 0011 J - 0110 )^ U =^i 1001 =:g 5l{o,i}i«bad 

0011 1001 J 1111 

g(x,y) + 3 = max WyZ [f(z,y) + f(w,x) + h(z,w) + u {3} (z) + u {Q} (w)} 
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